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Abstract 

In this note we introduce a method to calculate the finite volume corrections to the mean 
field results for the free energy when replica symmetry is broken at one-step. We find that the 
naive results are modified by the presence of additional corrections: these corrections can be 
interpreted as arising from fluctuations in the size of the blocks in the replica approach. The 
computation suggests a new approach for deriving the replica broken results in a rigorous way. 

1 Introduction 

The exact solution of the mean field theory of a wide class of spin glasses and other disordered models 
can be found using the replica approach. When we lower the temperature these models undergo a 
phase transition: the system freezes in a highly correlated phase without necessarily breaking any 
symmetry of the Hamiltonian (sometimes the Hamiltonian has no symmetry at all). The replica 
formalism allows us to describe this phase transition in a spontaneous symmetry breaking framework 
[H [2] . One introduces the replica symmetry that is spontaneously broken in the low temperature 
phase. 

Although many of these results can be obtained in a rigorous mathematical way, the original 
replica method is not crystal clear from a pure mathematical viewpoint. We shall also see that 
there are ambiguities when we compute the finite volume corrections. The analytic framework of 
the replica method needs a deeper comprehension and this work should be a contribution in that 
direction. 

There is a perfectly well understood physical interpretation of the phenomenon of replica sym- 
metry breaking using a probabilistic approach: all the computations can be done in a transparent 
way without ever introducing a non- integer number of replicas [U [2j. Unfortunately at the present 
moment this probabilistic approach does not allow us to calculate in a simple way the finite volume 
corrections. In principle the replica method allows such a computation, but the naive results turned 
out to be wrong, if compared with the exact results for the random energy model (REM) of Derrida. 
The absence in the conventional replica approach of a term corresponding to the fluctuations of the 
parameter m was clearly identified as the likely source of this discrepancy 0, [7] . 

In this note we show that the results of the usual one step replica symmetry breaking solution 
can be obtained within a conventional saddle point approach if a given infinite class of saddle points 
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is taken into consideration. In this way we have a well defined mathematical setting where we can 
compute the finite volume corrections to the mean field results and derive results that are correct in 
the case of the REM. 

The usual parameter m of replica symmetry breaking appears as an integration variable. In the 
infinite volume limit the m integral is rapidly oscillating and it is dominated by a saddle point in the 
variable m, where the integration path in the complex plane is perpendicular to the real axis. This 
explains why the saddle point in the conventional replica approach is a minimum and not a maximum 
as function of m. Of course we still have to justify why the sum over the particular class of saddle 
points we have chosen should give the exact results, however this is a well defined mathematical 
problem, that we will not address here. 



2 A short introduction to the replica method 

In disordered systems we are interested in computing the average free energy F((3) defined as 

F{(3) = - lim F N (P) , F N (P) = (iV/?)- 1 ln(Z iV (/3)) , (1) 

N— *oo 

where the bar denotes the average of the random instances of the problem and Zn(/3) is the partition 
function for a system with N degrees of freedom at inverse temperature f3. 
The quantity F{(3) can also written as: 

limFW(/3) , (2) 

where 

F^{3) = - lim (nNpyHn (z N (/3) n ) (3) 

In the replica formalism one introduces a temperature-dependent effective free energy F(Q a i,), 
where Q a t, is a symmetric matrix zero on the diagonal, the pairs of indexes a, b assume n(n — l)/2 
values; eventually n has to go to zero in the calculation of the physical quantities. In many interesting 
cases one can derive the exact representation 

Z^W = C(N,n) J dQexp(-N(3F(Q)) , (4) 

where C(N,n) = (2nN) n ^ n ~ 1 ^ 4: . For lightening the notation we have not indicated the obvious 
dependence of F on n and (3. Moreover in some models (depending on minor details 0), one should 
add sub leading terms in N in the exponent: we will not consider in this note this complication that 
is irrelevant for our aims (however it is crucial if one wants to obtain expressions correct at the 
subleading level in a given model). 

The permutation group of n elements acts naturally on the matrix Q, i.e. (Q n ) a ,b = Qw{a),TT(b)- 
The function F(Q), that depends on the model, is invariant under the action of the permutation 
group (the so called replica group). 

If we use formally the method of the point of maximum (that is justified in the limit iV — > oo), 
the free energy density is given by 

F = lJmF(Q*) , (5) 

1 These corrections are absent in the Sherrington Kirkpatrick model for spin glasses, if the coupling are Gaussian 
random variables, but they are present in the case of bimodal distribution of the couplings. 
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where Q* is the (supposed unique) stable solution of the equation 



dF(Q) 

9Q a ,b 



. 



(6) 



More precisely a solution of the previous is stable if the Hessian matrix 



dF(Q) 



(7) 



dQa,bdQ c ,d 



is a non-negative matrix. 

If we solve the previous equations for integer n, the solution is an n x n matrix (no analytic 
continuation is needed at this stage). For integer n the maximum solution is always given by a 
matrix where all off-diagonal elements are equal, i.e. Q a ^b = g; in this case the replica symmetry 
is exact (i.e. the solution of eq. ([5]) is invariant under the permutations of n elements): this is the 
replica symmetric (RS) solution. The properties of this solution can be analytically continued in n 
up to n = 0, that is the interesting point. At low temperatures it may happen that the RS solution 
is no longer stable for small n (n < 1). This means that in the low temperature phase the relevant 
solutions eq. §5§ are not invariant under the replica group. The way in which this replica-symmetry 
is broken depends on the particular model but basically two main universality classes have been 
identified in mean field models. 

For a first class of models the mean field solution Q has the one-step of replica symmetry-broken 
(1RSB) form. In this case the possible values of Q a b are only two: Q a b = go or Q ab = q x (with 
<?i > Qo)- 111 many of the models q\ ^ go = 0. For simplicity in this first approach to the problem 
of calculating finite size corrections we will only consider here the case where go — 0. 

For integer n the 1RSB solution can be represented in terms of an n x n matrix with n/m blocks 
of size m x m on the diagonal. Outside the blocks Q a b = go, while within the blocks Q ab = q\. 



Eventually in the replica method also m takes non-integer values. Models, where the replica symme- 
try is broken at the one step level, are interesting for their relevance to the behaviour of structural 
glasses [31 E]. 

For a second class of systems the low temperature solution can be parameterized in terms of a 
continuous function q(x). These models have a different phenomenology from models of the first 
class and the physical interpretation of the solution is more involved [TJ [2j [5]. 

In this note we will only consider models of the first class (1RSB) and we try to obtain a deeper 
comprehension of some points of the replica method in this simpler case. 

A difficulty present in all models with a replica symmetry breaking transition (i.e. models of the 
first and of the second class) is related to the analytic continuation in n. Indeed we have to find the 
solution of eq.([5]) for n = and we have to provide an Ansatz on the form of the matrix Q. Of course 
0x0 matrices do not exist in reality, but they may be considered as the analytic continuation up 
to n = of some matrices that are defined for convenient integer positive values of n (one continues 
analytically not the matrix, but scalar functions of the matrices). This space is huge and there is 
no definite number of parameters over which we can maximize the free energy to obtain the saddle 
point solution. A way to bypass this difficulty is to decide a priori the form of the solution with a 
fixed number of parameters: we restrict ourself to a particular family of solutions and determine the 
best solution within that family. 



Qab — Qi, if Int (a/m) = Int(6/m) 




(8) 
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In models where the 1RSB solution is correct we assume that the solution to the saddle point 
equations is of the previous described form (eq.©). Under this assumption it is possible to compute 
the effective free energy as function of qo, qi, n and m. The form of the effective free energy can be 
analytically continued to n = and to generic m. In this way one obtain an effective free energy 
F(qo,qi,m) where m is a real parameter (eventually the parameter m turns out to belong to the 
interval [0 — 1]). The solution to the saddle equation can be found by extremizing the free energy 
with respect to qo, q% and m. In the three cases (go — Qi, m — and m = 1) we recover the replica 
symmetric solution. It is remarkable that the free energy in the replica broken case is higher that 
the free energy in the replica symmetric case. 

We acknowledge that in this approach we choose a priori the form of the solution and, unless 
we find an alternative way to solve exactly the particular model, there is no way to assure ourselves 
that there is no other solution, maybe completely different, that gives the exact free energy density. 



3 A simple exact representation 

Let us consider a system with infinite range interactions where the mean field approach gives the 
correct results in the thermodynamic limit. As starting point we follow backwards Derrida's approach 
to REM [9] and use an integral representation of the logarithm to calculate the average free energy: 

\nZ N = — (exp(-t) - exp(-tZ N )J . (9) 

Let us define 

exp(-(f>(t, AO) = exp(-tZjv) . (10) 
We now perform a Taylor expansion around 0: 

ex V {-tZ N ) = £ U-t) k Zl. (11) 

fc=0,oo K - 

and compute Z% using the representation mentioned in the previous section 

~Z% = C(N, k) J dQ exp(-NpF(k, Q)) , (12) 

where the integral is done over the parameters of the k x k matrices. 

The reader should notice that the Taylor expansion in eq. (ITTj) is probably non-convergent: in 
the case of Gaussian disorder Z^ diverges as exp(Ak 2 ) for large k. However we shall see later that 
this might not be a problem. 

In this approach everything is written in terms of the average of the partition function to an 
integer power and therefore no analytic continuation is needed. The value of Z^ could be evaluated 
in the large N limit using a saddle point approximation in eq. ffl2|) . However, when the volume 
N goes to infinity, we have to evaluate the sum for large values of t (ln(t) ~ N) and different 
terms may cancel. Therefore we are not allowed to restrict ourselves to the leading estimate of the 
Z%. Nevertheless, if a sufficiently accurate evaluation of the the quantities Z^ is done for large N, 
we should obtain the correct result. We will conjecture that there is an effective way to do this 
computation. 
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4 New conjectures 



As a consequence our task is to obtain the best approximation to the quantities in the large N 
limit. We must obtain uniform approximations because the expansion in powers of t in eq. (1121) 
cannot be exchanged with the integral over t. The reader should notice that here we stick to integer 
k and no analytic continuation in k is done. Naively one could think that if we know exactly the 
function for all k, we also know its analytic continuation at non-integer k. However this is not 
evident in this particular case. Indeed if A is a positive quantity, the knowledge of the moments 

A {k) ee / d^(A)A k (13) 
Jo 

determines the positive measure n{A) in a unique way only in some cases. In particular if 

E (A«)- 1/ * = oo, (14) 

fc=l,oo 

the measure is unique. Unfortunately in our case the J have a Gaussian distribution H and the 
moments increase as exp(C/c 2 ). The question of uniqueness is therefore open. 

For each given k there may be many stationary points of the argument of the exponent in equation 
l fP2l and the leading contribution when N goes to infinity can be easily evaluated. However, as already 
remarked, this is not sufficient because of the strong cancellations and subdominant terms must be 
taken into account. We find it convenient to make two conjectures that allows us to make further 
progress. 

• We conjecture that if we approximate Z^ by the sum over all the saddle points, this approxi- 
mation is enough to obtain the correct results if inserted into eq. (JTTT) . It may be not so simple 
to classify all the saddle points for the function F(k, Q), although in some cases it is possible. 
We have the task of finding all the solutions for integer k of the equation dF(k, Q)/dQ = 0. 

• We further conjecture that in the case of one step replica symmetry breaking, the correct 
results are obtained if we only consider some saddle points that generalize the one step replica 
symmetry breaking. 

Let us be more specific. We will restrict our search to those matrices Q that can be divided into 
blocks of size mj, where Y^\=i m i — k and m ; > 0. (Here I is the total number of blocks of the 
matrix.) The off diagonal elements of Q a b have a constant value (that may be I dependent) if a and 
b belong to the same block. In other words 

Q ab = qt if a G Bi, be B { . (15) 

Moreover we consider, as candidates for the stationary points, only matrices where Q a b is zero if a 
and b do not belong to the same block. This last requirement is reasonable in the case where it turns 
out that go = in the usual replica approach. 

In this way each stationary point is characterized (apart from permutations) by the size of the 
blocks Bi ee rrii and by the values of qi. The same contribution appears more than once. To determine 

2 If the distribution of the coupling J is bounded, the analytic continuation would be uniquely defined. 
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its multiplicity we imagine performing all possible permutations of the k rows/columns and checking 
whether the matrix generated is different. For instance, if all rrii are different, the contribution is: 



h\ 1 
~i — ' — r exp {-Nf3F({m})) 6(£ mt-k), (16) 
nU^ ! i=i 

where I is the number of blocks in the matrix Q 0. 

5 The leading term 

Let be more definite and let us put these conjectures at work. The prototype models we have in mind 
are spin glasses models with with a p-spin interaction. For p > 2 their low energy phase is described 
by one step replica symmetry breaking and in the limit p — > oo they coincide with a soluble model: 
Derrida's REM 0HD]. 

In these models one can verify through an explicit computation that at the saddle point the 
leading term when N goes to infinity is factorized into contributions from each block. Neglecting 
terms of order 1 the final expression for the contribution of a given saddle point is given by 

exp (-N/3F({m})) = exp (-N E /?m,(/K)) J . (17) 

We must now sum over all the possible saddle points, counted with their multiplicity. The final 
result is 

00 fc' / — , 

Z n= £ U oo ~ \ (rn u Vm ex P ~ N P £ v m mf{m) ] S{J2mu m - k), 

Vl ,v 2 ...=0 llm=l L/ m-\" 1 '-) y m=l,oo 

where v m is the number of blocks of size m. The quantity —f(m) is equal to the 1RSB free energy 
whose form depends on the model. In the REM one verify that that one obtains the correct formulae 
using 

«.)--!--¥■ ™ 

Indeed in the particular case of the REM the previous representation is exact without subleading 
correction. The computation was done in an explicit way in [9J. 

We can now use the previous expressions for Z% in the computation of exp(— </>(t)). Using ( TTHl) 
we can write 

00 (—f\ k / 00 (— f) r \ 

exp(-0(t, N)) = E -TT Z n = ex P E «p(-r W(r)) . (20) 

fc=0 K - \r=l r - J 

A detailed computation shows that the limit, where N and t both go to oo at constant y = \nt/N, 
is relevant to compute the average free energy (this is justified a-posteriori). We just face the problem 
of evaluating in this region the quantity 

- <j>(t, = £ exp(-rAW(r)) • • (21) 



5 For simplicity we have assumed that we have only one non-zero solution for the {q} at fixed {to}. 
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For this purpose we follow the method (introduced in this context by [SJ [TTJ) of transforming the 
previous sum into an integral in the complex plane around the integers r = 0, 1,2, 3.. .00 and then 
deform the contour of integration to obtain an integral in one variable that can be evaluated by the 
saddle point method in the complex plane. 

In this way we obtain 

-6(tN) = -f *MN{xy-x{3f{x))) 

nh } 2iJc r[l + x]sin[7ra;] ^ ' 1 ] 

where y = \nt/N and C is an appropriate integration path in the complex plane: C goes from +oo+ie 
to +00 — ie crossing the real line at < x < 1. This path may be deformed by breaking it into smaller 
circles running counterclockwise around the positive integers so as to obtain the previous formula. 
We now deform it so that it goes from — ioo to +200. The possibility of doing this deformation is 
not clear. However quite often the sum in eq. (|21[) is not convergent and the rotation of the path in 
the complex plane may be a possible way of giving a meaning to this non-convergent sum. 

We now try to see what happens when N goes to infinity and we separate the leading from the 
subleading terms. We look for a saddle point in the complex plane. The equation for the saddle 
point (i.e. x sp ) is 

Pf(x sp (y)) + x sp {y)(3f'{x sp {y)) ~ V = 0- (23) 

Let us assume, for simplicity, that the leading contribution come from the region where < x sp < 1 
0; indeed in the saddle point approximation for the t integral the dominating values of y will be such 
that < x sp (y*) < 1. If the In this case we have at the leading and first sub-leading order 

- <f>(t, N) = C(y) exp (Nx sp (y)(y - f3f(x sp (y))) , (24) 

and 

c( v ) = ,/ 1 n-xsp(y)} (25) 

V 2nN(3 ^- 2 f( Xsp (y)) - i,(y)f(x,(y)) 

is a (positive) quantity whose value is irrelevant to leading order in N, but will be useful in the next 
section. 

In order to extract the leading order contribution we notice that for large N 

0(t,JV)»O =^ exp(-0(t,JV)) = l if y-(3f(x ap (y))<0, (26) 
0(t, N) w 00 =>- exp(-0(t, iV)) = if y - (5f{x sp {y)) > . (27) 

In other words we can approximate exp(— <f>(t, N)) with or 1 depending on the sign oly—(3f(x sp {y)). 
This approximation being not valid in a region of with 1/N (in y) around the point 

y* = Pf(x sp (y)) . (28) 

Finally we obtain 



roc (J+ 

lnZ N = -(exp(-t)-exp(- ( f ) (t,N))=Ny* + 0(l) . (29) 
Jo t 



'oo dt 
lo 1 

Note that equations f[2"3"j) and (j5SJ are equivalent to 



f'(x sp ) = , (30) 



J This is usually true at low temperatures, at high temperatures x sp > 1 and we stay in the unbroken replica phase. 
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that is the saddle point equation for the size of the block of the 1RSB solution. In the replica 
approach the previous equation is derived maximizing with respect to x the function f(x) that has 
the meaning, from equation (fT8j) . of free energy density (per replica) of x replicas in a state with 
overlap q = q\. We have rederived the usual equation of the replica approach with one step symmetry 
breaking following a different route. 

We notice that the condition x sp < 1 is equivalent to the condition T < T c . It is possible that 
fluctuations over x are connected to sample-to-sample fluctuations of the critical temperature. In 
any case for x sp > 1 i.e. T > T c , the form of the finite- N corrections is different because they are due 
to the existence of other saddle points that have a weight that is proportional to exp —Nfj,(T)/u(T) 
where both [i{T) and v(T) tend to zero as T approaches T c . We will not discuss anymore this point 
that was studied in details in 0,0 • 



6 Finite N corrections 

The aim of this section is to compute the free energy taking into account the first corrections in 1/N. 

According to the replica folklore we should be able to compute these corrections in a straightfor- 
ward way. We should have that 



In (Z N (J3)) = -/3NF N (J3) = -f3F(Q*) - Tr(ln(/W)) + ln(M(m)) , (31) 
where we have used the short hand notation 

- fr(A) = hm Tf {A{n)) (32) 

and M(n) is a multiplicity factor given by 

lim n' 1 log(P(n, m)) , (33) 

n— »0 

where P(m, n) is the number of way in which we can divide n replicas in m groups of n/m replicas. 
As we have seen 

P(m,n) = - — - — — — , , (34) 
v ; {n/m)\{m\) n l m v ' 

and therefore 

. . . rm -in(r[i + mi) , , 

M(n) = -r'(l) + —-^ V 1 iJ . (35) 

m 

The previous formula have a doubtful derivation. In particular it is not clear why one should take 
the contribution coming from a particular value of m rather than those coming from other values of 
m. We could mumble that the sum over m should become a integral, but is not clear which should 
be the integration measure. Moreover we cannot include in this way the contribution coming from 
different values of m because their contribution would be dominant (in the replica approach we have 
maximized, non minimized the free energy). 

Instead the approach presented in this note allows us (at least in some cases) to do the compu- 
tation of the subleading corrections. We will assume that in the leading and in the next to leading 
order the contribution of each block factorizes. The final expression for the contribution of a given 
saddle point is given by 

expfei-PNmJim,) - Mm,))) . (36) 
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where 

f 1 (m)=TrQn(jm)). (37) 
The 1/N corrections arise from two sources. 

• The integral over y has been done approximating the integral with a step function. A more 
accurate computation, where one consider corrections that are of order (1) for y — y* of order 
1, gives a contribution of order 1/N to the free energy density. We call these corrections AFm- 
At this end we must use the the expression for C(y) shown if eq. (1251) . 

• The corrections coming from the fluctuations of Q a t, = q a b + 8q a t, around the saddle point of 
solution Qirsb- The final effect of these corrections is denoted AFq and it equal to fi(m). 

The computation is similar to that in [9] and we find: 

N/3F N (P) = N(3F{x sp ) + AF M + AFq , (38) 

where AFm is given by 

AFm = (I _ 1)r <(l) - MFd-m)) + m ( W/w(-/"W)) (39) 

m m 2m 

We caution the reader that in many cases the factorization property of the subleading corrections 
is not true and therefore the value of AFq may be incorrect (this point should be carefully inves- 
tigated). However the distinctive feature of this approach is the presence of the term log(iV) in 
the subleading corrections. This is the consequence of having done an extra saddle point integration 
(with respect to the conventional ones), i.e. the one over m: it should be impossible to recover it 
in the conventional replica approach. As far as we can see the presence of such a term (in the free 
energy) should be a quite general feature of one step replica symmetry breaking and it should be 
relatively easy to detect it numerically. 

In the case of the REM we can verify that we obtain the correct formulae using eq. ( 1T91) . In this 
case terms coming from the determinant are trivial (if we use the replica approach to solve the REM) 
and therefore we should put AFq = in the previous equations. Indeed in this case equation fl39l 
coincide with the expression obtained by Derrida by an asymptotic expansion of equation (Q. In this 
case the equation for x sp can be explicitly solved, obtaining x sp = T/T c . In more general cases one 
has a more complicated function f(m) and the saddle point equations have to be solved numerically. 
It would be interesting to check if one gets the correct finite volume corrections in simple model like 
the p-spin spherical model and the p-spin Ising model. 



7 Conclusions 

In this note we have shown that by starting from a reasonable form for the leading contribution in 
an exact representation we recover the one step replica broken solution. We introduced a method 
to calculate the fluctuations over the parameter m of the solution. In doing so, the parameter m 
is the saddle point value over an integrating field of which we provided the correct measure. In 
all our calculations we could check the limit of uncorrelated energies (REM) for which we had the 
solution obtained by Derrida without making use of replicas. Finally, as a side effect, we gave an 
explanation of the mechanism why in the 1RSB the value of m = T/T c is actually a maximum and 
not a minimum. 
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Let us finally remark that the fluctuations on m are important below T c , indeed their contribution 
to the finite-size corrections of the free energy diverges approaching T c from below. It is possible that 
these fluctuations are related to sample-to-sample fluctuations of the critical temperature. In this 
sense one could say that perturbative corrections to m sp reproduce non-perturbative corrections to 
the matrix Q: when m changes, there are some elements Q a b that change abruptly from go to q± and 
vice- versa. In some works p2] it has already been noted that, in short range models, these effects are 
possibly responsible for the rising of a diverging correlation lengths as approaching T c from above. 
It could be interesting to extend our method to short-range models with the aim of predicting some 
of their peculiar features. 
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